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I. INTRODUCTION 


In their 2002 papers, Gravel and Winternitz discovered new superintegrable potentials 
depending on solutions of nonlinear ODEs including Painleve transcendents and elliptic 
functions. These new systems are strikingly different from all previously known superinte¬ 
grable systems. Indeed, while these systems are still exactly-solvable in the sense that their 
energy spectrum can be obtained using algebraic methods, see e.g.- 1 ^, these Hamiltonians 
do not possess the stronger properties usually associated with exact solvability. Namely, 
either that the Hamiltonian can be expressed as an element of the enveloping algebra of 
a two-variable differential operator representation of a Lie algebra 4 or that the wavefunc- 
tions can be expressed as a ground-state multiplied by an orthogonal polynomial. These 
new potentials also were superficially different in that they cannot be expressed as rational 
functions in any coordinate system. 

The further investigation of third-order superintegrable systems that admit separation of 
variables in Cartesian^ and polar coordinates^ lead to the discovery of even more “nonlinear” 
potentials, with at least one potential depending on each of the Painleve transcendents. 
Here, we emphasize that the potentials are solutions of nonlinear determining equations; the 
Schrodinger equation is still linear. These further discoveries, along with recalling that the 
defining equations for a superintegrable potential are nonlinear, might lead one to believe 
that such “nonlinear” potential are ubiquitous. However, extending the search to other 
coordinate systems including parabolic- and, as we shall see later, elliptic coordinates yields 
not only no nonlinear potentials but also no new potentials at all. Thus, we are left to 
conjecture that there is something special when subgroup-type coordinates are considered. 

The goal of this paper is to review the previous results concerning systems that admit a 
third-order integral and are separable in Cartesian, polar and parabolic coordinates as well 
as to present new results for the elliptic case. We shall show that nonlinear potentials are 
present only in the subgroup type coordinates while for the other two coordinate systems 
all potentials satisfy some set of linear ODEs. The mechanism for this disparity is still not 
well understood and so, in the conclusions, we offer some conjectures and open problems 
suggested by these results. 

Before we specify the separation in a particular coordinate system, let us review the 
general determining equations for a third-order integral of motion, see e.g.- 1 . We consider 
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scalar Hamiltonians on 2D Euclidean space defined by 

H = ^(pl+p 2 2 ) + V(x 1 ,x 2 ), (1) 

where either pj are the conjugate momentum for classical mechanics or pj = — ihd Xj for 
a quantum mechanical operator. Suppose now that the Hamiltonian admits an integral of 
the motion that is third order in the momenta. Due to the form of the Hamiltonian dTJ) , it 
is possible to express any third-order integral as 

X = - E A i,kA L l,PiP 2 } + {9i{xi,x 2 ),Pi} + {g 2 (x 1 ,x 2 ),p 2 } ] , (2) 

Z \j,k,i ) 

where the bracket here is the symmetrizer {A. B } = AB + BA which is trivial for X a 
function on 4D phase space in classical mechanics but necessary when the pj are differential 
operators. Also, L 3 = x\p 2 — x 2 pi is the generator of rotation. The integral (J2J) contains 
only odd-order terms since even and odd order terms will commute independently. See^ for 
a proof of the generality of this form as well as the following determining conditions which 
ensure that X is an integral of the motion. Namely, the determining conditions reduce 
to the following PDEs. The highest order determining equations, obtained from fourth- 
order terms in the momenta are identically zero due to the choice of leading order terms 
in the integral (J2j), namely as elements of the enveloping algebra for e 2 (M) (and, vice versa, 
elements of the enveloping algebra are the only solutions of the highest order determining 
equation). The next set of determining equations are obtained from requiring that terms 
that are second-order in the momenta are identically zero and are given by 

<7i,i = 3Tj Hi + F 2 V 2 (3) 

0i,2 + 02,i = 2(F 2 Ei + F 3 V 2 ) (4) 

02,2 = F 3 Vi + 3 E 4 H 2 , (5) 

where 

F\ = A. 300^2 + ^210^2 — ^102^2 + A)30, 

F 2 = 3A 3 oqXixI — 2A 2 i 3 xix 2 + A 201 X 2 + ^ 120^1 — ^ 111^2 + A 021 , 

F 3 = —3A 3 qqx\x 2 — 2A 20 iXix 2 + A 2 io^i + ^-m x i ~ Aiq 2 x 2 + An2 ; 

F 4 = ^oo^i + A 2 oi^i + A 10 2 Xi + A 0 03- 
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The functions Fj are the leading-order terms of X as in 

X = ih\F x dl + F 2 dld 2 + F 3 <9i<9 2 2 + F A dl ) + .... 

In equations (EHSl) and what follows, we use the notation 

f,i = dif, di = 

OXi 

The next set of determining equations comes from zeroth order terms in the commutator 
and are given, modulo the other determining equations by 

0 = (^gi — ti 2 (— 2 A 300 X 2 + -^ 210 )^ Vi + ^92 — ^- 2 (2A 3 ooaq + -A 2 oi)^ ^2 
h 2 

—— (T 1 V 111 + F 2 \ 112 + F 3 V 122 + F 4 V 222 ) ■ ( 6 ) 

The classical version is obtained by simply setting h— 0. As discussed in-, the odd-ordered 
terms are differential consequences of these determining equations. 

Given a potential V (aq, X 2 ), the functions g± and g 2 can be obtained immediately from the 
determining equations (1315]), which can then be substituted into () 6 |) . The problem is then 
to find potentials V(x\,x 2 ) and leading-order constants A that satisfy the compatibility 
conditions for these determining equations. The compatibility condition for (CUED is 

0 = —F 3 V 1 11 + (2 F 2 — 3F 4 )1 112 + (—3Ti + 2iq)Di 22 — F 2 V 222 
+ 2(F 2i2 — F' A \)V]\ + 2(—3F 1j2 + F 2A + F 32 — 3F 4 j1 )Vi 2 + 2(—F 2>2 + i 7 3 il )V 22 
+ (—3i ? i >22 + 2F 2 j i 2 — F 3 j ii)Vi + (—F 2) 22 + 2F 3 i i 2 — 3F 4) n)V2. (7) 

(There are also nonlinear compatibility conditions that come from isolating gi (assuming 
V\ 7 ^ 0 ) from the the fourth determining equation (EJ), taking a derivative, using (EHSl) to 
simplify, isolating g 2 and repeating the process. This results in three, nonlinear determining 
equations for the potential^.) 

The remainder of the paper is dedicated to the solution of this problem, under the assump¬ 
tion that the potential separates in an orthogonal coordinate system in real 2D Euclidean 
space. Under this assumption, the potential V(aq,x 2 ) can be written in terms of two one- 
variable functions. The linear compatibility conditions flTJ) can then be reduced to a pair 
of ODEs. I 11 particular, by assuming that V(xi,x 2 ) can be expressed in terms of the new 
potentials V\ (yi) and ^ 2 ( 1 / 2 ) and restricting one of the variables to a regular point, for ex¬ 
ample 1/2 = 7 / 2 , linear compatibility condition is reduced to a linear, third-order ODE 
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for Vi (y\). Thus, unless dHJ) is satisfied identically, the potential will have only non-movable 
singularities. We call such potentials “linear.” In this case, the potentials satisfy also the 
nonlinear compatibility conditions but the equations act instead by reducing the solution 
space of the linear equations. On the other hand, if (J7D is identically zero, then the potential 
will be a solution to the nonlinear compatibility conditions, and may have movable singu¬ 
lar points. It is these solutions that correspond to nonlinear special functions, including 
Painleve transcendents and elliptic functions. 

Section II gives the analysis for subgroup-type coordinates (Cartesian and polar) as well 
as the resulting “nonlinear” potentials. Section III gives the analysis for the remaining 
coordinate systems (parabolic and elliptic), including the result that all potentials are “lin¬ 
ear” and in particular have only non-movable singular points. Section IV includes some 
concluding remarks and conjectures. 

II. SUBGROUP-TYPE COORDINATES 

As it is well known, there are 4 in-equivalent choices of orthogonal coordinates for which 
the Helmholtz (zero-potential) admits separation of variables^A Namely, Cartesian, polar, 
parabolic and elliptic coordinates. Before presenting the results on the potentials, let us 
briefly describe the group theoretic interpretation of the separable coordinates in 2D real 
Euclidean space. Each coordinate system is determined by a second-order linear operator 
that commutes with the Laplacian. Up to conjugation by elements of the group e 2 (ffi), the 
second order operators are 

Pi, L h Pi L 3, Ll + cpl. 

The first two, p\ and L\ are second-order invariants of the two, inequivalent maximal Lie 
subalgebras of e 2 (K), namely the subalgebra generated by {pi,P 2 } and {-L 3 } respectively. 
Thus, these coordinates, Cartesian and polar respectively, are referred to as subgroup type 
coordinates^. 

A. Cartesian 

We begin with Cartesian coordinates and summarize the results of Graved. Setting 
X\ = x, x 2 = y, the potential separates as V(x,y) = V\ (x) + V 2 (y), so that the Hamiltonian 
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is given by 


H — \px + dy\ + Vl( x ) + V2(y), 

with second-order integral 

y = ~y q I + v ^ x )- 

The linear compatibility condition (JTJ) reduces to 

F^Vl,xxx 4T3 x V l,xx ^-^3,xx 'hi ,x F2V2,yyy F ^ L F 2 ,yV 2l yy T QF 2j yyV2y ( 8 ) 

Here the determining equations for the coefficient functions Fj, namely 


Fj.x + Fj_ ]t y — 0, J — 1... 5, F 0 — F 5 — 0, 

have been used to simplify (jSJ). Fixing the value of y at a regular point y°, the compatibility 
condition (jHJ) becomes a third-order ODE for the function V\ with only regular singular 
points, since the leading order term is a quadratic polynomial in x. Similar reasoning shows 
that V 2 has only regular singular points. Thus, if both sides of equation (|8j) are not identically 
zero the potential has only regular singular points which are of course non-movable. 

Let’s consider the potentials (and coefficients Ajki) for which at least one of the sides 
of equation (jHJ) vanishes identically. There are two possible cases. The first is that (jEJ) is 
identically satisfied for any V\ and V 2 by choosing appropriate coefficients. This would be 
the case if and only if both F :i and F 2 were identically 0. The second case is where F :i is 
identically 0 and V 2 satisfies a linear ODE, or equivalently F 2 is identically 0 and V\ satisfies 
a linear ODE. 

a. Case 1 Let us assume the coefficients are chosen so that F 3 = 0 and F 2 = 0. In 
this case, the only non-zero A 3 yj are H 0 3 o and H 0 o 3 and it is possible to solve directly for 
gi(x, y) and g 2 {x,y) and to substitute these solutions in ([6]). By separating variables and 
integrating, the nonlinear determining equations for V\(x) and V 2 (y ) are reduced to 


H 2 V"(x) = 6Vi(a:) 2 + A 003 ax, 

(9) 

-ft 2 V”(y) = CV 2 {yf + Aowoy. 

(10) 


Depending on whether or not cr = 0, the solutions are either Weierstrass elliptic functions 
or Painleve transcendents P\. In the classical case, h — 0 and the potentials are linear 
combinations of ±y/x and ±y/y. 
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b. Case 2 The other possibility is for the linear compatibility equations for V\ (x) to be 
satisfied identically and the one for V 2 (y) to be non-trivial. This is the case when F 3 = 0 so 
that the only non-zero coefficients are H 030 , H 003 , ^120 an d A 02 i . In this case F 2 = A 12 qx+Aq 21 
and V 2 (y) satisfies the linear ODE 

0 = (A 12Q x + Aq 21 )V 2 " =>• V 2 (y) = ay 2 + a'y. 

Thus, up to translation in y, there are only two distinct cases V 2 (y) = ay 2 and V 2 (y) = 
ay. Recall, a constant term in the potential is trivial. I 11 the former case, new quantum 
solutions for V\{x) are obtained that depend on the fourth Painleve transcendent and new 
classical solutions are obtained as a root of a fourth-order polynomial equation, and includes 
a smooth interpolation between a 1:1 and 3:1 anisotropic oscillator. For the final family of 
solutions, with V 2 (y) = ay , new solutions are obtained depending on, again, the first Painleve 
transcendent as well as new solutions depending on the second Painleve transcendent. 

To briefly review the Cartesian case, not only were new linear potentials obtained, such 
as the 3:1 oscillator and its singular form, but also new nonlinear potentials in both classical 
and quantum mechanics. New quantum potentials included ones depending on the first, 
second and fourth Painleve transcendents. 

B. Polar 

Let us now consider systems that admit separation of variables in the polar coordinates 

X\ — r cos 6 , x 2 = r sin 9 , 

and so the Hamiltonian can be expressed as 

H=^~(-d r rd r + + R{r) + \ S(9). 

2 \v r J r 

The second-order integral of motion responsible for separation of variables is 

y = +s(e). 

The analysis of this case was first performed by Tremblay and Winternitz^ and here we 
review the results of their analysis. In polar coordinates, the functions Fj serve the same 
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function as in the Cartesian case, namely that they are the leading terms of the 3rd-order 
integral expanded out with coefficient functions written on the left, 


A — ih 3 (F 4 dg + F 3 dgd r + F 2 dgd 2 A FlO 3 ') + ..., 


The functions Fj are defined as 


F 2 

f 3 

f 4 


Ai cos 36* + A 2 sin 3 9 + A 3 cos 9 + A 4 sin 6 

~ 3M sin 3fl+3A 2 cos 36-A 3 sin 0+A 4 cos 6 + ^ CQg 2Q + ^ gin 2Q + B 0 

—SAi cos 30—3A2 sin 30+ As cos 6 +A 4 sin 0 1 —2B\ sin 20+21?2 cos 20 1 q Q \ (J 

^ 2 I I 1 I 2 

Ai sin 30—A 2 cos 30—A 3 sin 0 +Al 4 cos 0 i?i cos 20 +i ?2 sin 26—Bq C\ sin 0— C 2 cos 0 \ ta 

r 3 r 2 r 1 -Lsq. 


The coefficients are related to those in the previous section via 


A _ Ao 30 — Aoi2 A _ Aq21 Ao03 A _ 3 Ao 30 +Aoi 2 

■ A-l — 4 , Si 2 ~ 4 j -rl 3 — 4 j 

A _ 3 -Aqq3+Aq2i r _ A120—A102 r _ Am r _ A120+A102 

2*4 4 ? -^1 2 ? -^2 2 ? 2 ? 

Ci = A 210 , C 2 = A 204 , D 0 = A 30 o 

as in the original paper of Tremblay and Winternitz£. The equations (|3]|5]) are equivalently 
transformed. Most important for our analysis is the form of the linear compatibility condi¬ 
tions, which can be expressed as 


r 4 F 3 i? w + r (4 r 3 F 3jr + 6 r 2 F 3 + 3Fj) R" + (6r 4 F 3irr . + 20r 3 F 3jr + 6 r 2 F 3 — 3 F 4 ) R' = (11) 
- r-' 2 {F 2 S m + 4 F 2 , g S" + (6 F 2 ,oo - 6F+r + 4 F 2 )S' + (12 rF 2fir - 8 F 2>0 ) S ) + 36r“ 3 FiS. 


Again, we have used the first-order PDEs for the coefficient functions Fj to simplify this 
expression. 

In this form, it is clear to see that a regular point 9 = 9 0 (TTTT) gives a linear ODE for R(r) 
and so the solutions will have only fixed singular points as long as the left-hand side of dll]) 
is not identically satisfied. This ODE will be identically satisfied if and only if F 3 = 0 and 
Fi = 0 or equivalently + = A 2 = A 3 = A 4 = 0 , B\ = B 2 = 0 and C 4 = C 2 = 0. In this case 
the only non-zero coefficients are B 0 = (+ 20 + A 102 )/2 and D 0 = A 300 . With these values 
of the coefficients, the problem splits into two cases. When B 0 ^ 0 the potential is purely 
radial and the remaining conditions force the third order integral X to be algebraically 
dependent on the integrals L 3 and H. Thus the potential is not superintegrable but first 
order integrable. When B 0 = 0 , the right-hand side of (fill) is also identically 0 and so the 
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linear compatibility conditions for R(r) and S(9) are both identically satisfied. This is the 
analog of Case 1 in the Cartesian case. 

For the other case, let’s assume that R(r ) satisfies a non-trivial linear ODE and so has 
only non-movable singularities. Again, S{9) will also have only non-movable singularities 
unless the right-hand side of (TlTT) is identically satisfied. This will be the case as long as 
A 1 = A 2 = A 3 = A 4 = 0 and B 4 = B 2 = B 0 = 0. Unlike the previous case, the values of C\ 
and C 2 maybe non-zero. This is Case 2. 

Note that unlike separation in Cartesian coordinates, there is asymmetry between the 
functions R(r) and S(9). If the linear compatibility conditions for R(r) are satisfied identi¬ 
cally then those for S(9) will be as well. This is due to the fact that the functions F ?J and iq 
depend on more of the constants Aj k { than F 2 and so F 3 = 0 (together with the assumption 
that X is an independent third integral) implies F 2 = 0 but the other direction does not 
hold. As we shall see, there will be solutions where R(r) satishes a linear ODE while S(9) 
satishes a nonlinear one. 

c. Case 1 Polar In case 1 for polar potentials all of the Aj ke are 0 except A 300 and 
Ai 2 o T A 102 • From direct computations, the choice A 120 + A 102 7^ 0 leads to known potentials 
and the only new case is A 30 o 7^ 0. In this case, the angular part of the potential can 
be expressed as a Weierstrass elliptic function. However, the third-order integral obtained 
will be algebraically dependent on the second-order integral responsible for separation of 
variables. Thus this system does not admit an algebraically independent third-order integral 
and is not considered in this classification. 

d. Case 2 Polar Here we assume that the linear conditions for the angular part of the 
potential are satisfied identically. The only non-zero constants are C\,C 2 and Do and the 
radial term of the potential is given, up to a trivial additive constant, by 


R(r) 



In the original paper of Tremblay and Winternitz^, it is shown that the only potential that 
survives the remaining determining equations (jHHSJ) and dHJ) with aq 7 ^ 0 is the singular 
Coulomb potential, a well-know second-order superintegrable systems. When aq = 0 the 
term a 2 /r 2 may be incorporated into the angular part of the potential and so we are left 
with the case that R(r) = 0. In this case, there is a single nonlinear potential in classical 
mechanics, which satishes a first-order nonlinear ODE, and two potentials in quantum rne- 
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chanics one depending on the sixth Painleve transcendent and the second depending on the 
Weierstrass elliptic function. 

To briefly review the results of the polar coordinate case, there exist three “nonlinear” 
potentials, one in classical and two in quantum mechanics. Each of these three nonlinear 
potentials arise only in the angular part. 


III. NON-SUBGROUP-TYPE COORDINATES 

A. Parabolic 


Turning now to the conditions that the potential separates in parabolic coordinates 

e-v 2 


Xi = 


X2 = 


( 12 ) 


and with the Hamiltonian of the form 


H = 


-h 2 


[<9| + d 2 ] + 


Wi(£) + w 2 (v) 


2(£ 2 + V 2 ) 1 5 rJJ £ 2 + r\ 2 

The second-order integral responsible for separation of variables is given by 

1 - 2 {P2 ' i3} + - WW -• 


(13) 


with 

P2 = _^ 2 [£dv + V d £.] , L 3 = y [id v - Tjdz] . 

The conditions that the potential ([TJ) with a potential of this form admits a third-order 
integral were investigated by an author along with Popper and Winternitz^. Unlike the 
Cartesian and polar cases, it was shown that there are no potentials that satisfy nonlinear 
determining equations. In this section we review these results and recast the determining 
equations in an analogous way with the previous sections. 

As in previous cases, we define functions Fj composing the leading terms of the 3rd-order 
integral expanded out with coefficient functions written on the left, 


X = ih 3 {F\d'! + F 2 dp r] + F^d 2 + F 4 d 3 ) +.... 


rfA 300 V 2 (£A 2 io + ^A 2 oi) _ £ 2 ? ?bli 2 o + ff^Am + ?/ 3 A 102 

8 4(£ 2 + rf) 2(£ 2 + r] 2 ) 2 
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£ 3 A)30 + £ 2? ?A)21 + V 2 £A 0 12 + V 3 Aq03 


(£ 2 + v 2y 

p _ 3y 2 £,A 300 _ y{y 2 + 2^ 2 )A 2 iq + y 2 £A 201 tj(2if + £ 2 )A 12 q + 77 3 A m — y 2 ^A W2 

2 ““ 8 4(£ 2 + rj 2 ) 2(£ 2 + r/ 2 ) 2 

3£, 2 yA 030 + £(2ry 2 - ^ 2 )v4 0 2i + y(y 2 - 2£ 2 )A 012 - 37] 2 £,A 003 

(£ 2 + y 2 ) 3 

3^ 2 A 300 £(2y 2 + C~‘)A 2 w-yi 2 A 2 oi £ 3 A 1U + y£ 2 A 102 - y(y 2 + 2£ 2 )A 1 2 0 

3 - 8 4(£ 2 + r/ 2 ) 2 (£ 2 + r/ 2 ) 2 

3y 2 £A 030 + ?y(/y 2 — 2^ 2 )y4 02 i + £(£ 2 — 2-// 2 )A 01 2 + 3r]^ 2 A 003 

(£ 2 + , '7 2 ) 3 

p _ £ 3 4hoo ^ 3 ^2 oi — ^ 2 ^2io ?r£4Li2o — ?/£ 2 A m + £ 3 A 102 

4_— s - A(e + y 2 ) 2(e 2 +^ 2 ) 2 

^ 3 ^oo3 + y 2 tjA 32 i — y£ 2 A 012 — y 3 A 030 

(£ 2 + y 2 ) 3 

Note that these are not the same Fj given in a previous paper-, we have chosen this for 
consistency with the other cases of this article. Assuming the potential separates as (fT3|h 
the linear determining equation becomes 


F 3 w{" + (4F 3) * + (F 3 + 3F 1 )^e + y 2 )- 1 ) w; 

+ (6 F m + (£ 2 + y 2 )- 1 $ZF U - GyF 3 ri + 12 - 3(F 3 - 3F 1 ))) W[ + C X W X = 
-F 2 W”' - ( 4 F 2 , v + (F 2 + 3F A )r 1 (e + t ? 2 )' 1 ) W” 

- (6 F 2m + (£ 2 + y 2 )- 1 (6 {r)F 2tV - ^ + 2 V F^) - 3(F 2 - 3F 4 ))) W' - C 2 W 2 , (14) 


with 

r = 12 £F m - 12 rjF 3M + 12?7^ 1 (2y7 2 - £ 2 )F U , ? 

1 e + y 2 

24(e 2 - y 2 )F u - 24 jqF^ + 12?r 2 (4?/ 4 - 2 ifj 2 + £ 4 )F U + 12(4ry 2 - 3g)^Fi^ 

(£ 2 _|_ ^2)2 

12^(2r / 4 F 3 + 3(e 4 -eV)^i) 

7? 2 (£ 2 + r ? 2 ) 3 


and 


12r^ ~ 12^F 2 ,,g + 12TW - y 2 )^, 

£ 2 + y 2 

2A(e - y 2 )F 2 , ri + 24^F 2 , g - 12r 2 (4 £ 4 - 2 rfe + if)F^ - 12(4^ - g)TV^ 

(£ 2 + y 2 ) 2 

12 77 (2£ 4 F 2 + 3 (?/ 4 - £V )F 4 ) 

£ 2 (£ 2 + 7? 2 ) 3 
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From the linear compatibility equation, it is clear that both of the functions in the 
potential will have only non-movable singularities unless either the functions F 3 or F 2 are 
identically 0. In either case, this would require all of the A ]kf to vanish and so there would 
not be a third-order integral of motion. Thus, all potentials that separate in parabolic 
coordinates and admit a third-order integral of motion, depend on two functions that satisfy 
third-order linear ODEs. 

In practice, it is preferable to not deal directly with (TT4|) at regular points to obtain 
the separated equations for each of the components of the potential. Instead, repeated 
derivatives of (1TTD were computed until the equation depended only on one function, for 
example Wi(£) and then the coefficients of powers of gave a set of linear ODEs for Wi(£). 
These ODEs were solved^ and, somewhat surprisingly, all the potential obtained were already 
known and admitted a third, second-order integral of motion beyond the Hamiltonian and 
the integral associated with separation of variables in the coordinates (fT 2 lh 

To review, unlike the subgroup-type coordinates, the linear compatibility conditions for a 
third-order integral for a potential that separates in parabolic coordinates is never identically 
satisfied and so all such potentials have only non-movable singularities. Furthermore, all such 
potentials are actually second-order superintegrable and the third-order integral is obtained 
as the commutator of the two, non-commuting second-order ones. 


B. Elliptic 


Let us consider elliptic coordinates in the form 

X\ = uv 

x 2 = \/l — u 2 \Jv 2 — 1 


(15) 


where the ranges for the coordinates are —1<u<1,v>1. They cover the Cartesian 
halfplane prescribed by the condition x 2 > 0 . 

The Hamiltonian separates in these coordinates if it is given by 

4- W„(bh 

(16) 


h 2 (ud u +(u 2 - l)dl~vd v - (v 2 - l)d 2 ) Wi(m) + W 2 (v) 
ti =- _ , » -—-1- 


u 2 — V 2 


2 ( u 2 - v 2 ) 

This form of the Hamiltonian implies the existence of a second order integral responsible for 
the separation in the elliptic coordinates (TT5l) 


Y = Ll + - (pl-pD+F 


(17) 
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with 


.v(l - 

Pi = in - 


p 2 = —ih 




v 2 ) £ + u (v 2 

u 2 — V 2 
— u 2 ){y 2 — 1) 
u 2 — v 2 


1) 


d_ 

dv 



L 3 


.. a /(1 — u 2 )(v 2 — 1 ) / d d\ 
1 


and 


F(u, v ) = 


(2v 2 - 1 )Wi(u) + (2 v 2 - l)W 2 (u) 


■u 2 — v 2 


Written in the elliptic coordinates (ITS]) , the linear compatibility condition reads 


*3(1 2 ) 

V 2 — 1 


W"' + 


4(1 — u 2 )F 3jU u(F 3 -3F 1 ) 


v 2 — 1 


u 2 — v 2 


W” 


6F 3jUU (1 - u 2 ) -2u(2u 2 + v 2 - 3 )F 3tU + 6(v 2 - 1 )(vF 3jV + 2uF hu ) 


{v 2 — 1 ){u 2 — v 2 ) 

( u 2 v 2 + 11 u 2 - 9v 2 - 3 )F 3 + 3(5 u 2 + 3)(n 2 - 1 )F 1 




(1 — u 2 )(v 2 — 1 )(u 2 — V 2 ) 
4(n 2 -l )jy v(F 2 -3F 4 ) 

u 2 — V 2 


W[ + C[ Wi = 


W" 


1 — u 2 

6F 2 , vv (v 2 - 1) 2 v(u 2 + 2v 2 - 3)F 2 v + 6(1 - u 2 )(uF 2jU + 2vF^ v ) 


1 — u 2 (1 — u 2 ){u 2 — V 2 ) 

{u 2 v 2 + lln 2 - 9 m 2 - 3 )F 2 - 3(5n 2 + 3)(1 - w 2 )F 4 
(1 — u 2 ){y 2 — 1 )( m 2 — v 2 ) 


W' - C 2 W 2 . 


( 18 ) 


with 


— 12it(l - u 2 )F 3jUU _ 12 vF 3 ^ u 4(4 u 4 + 7 u 2 v 2 + v 4 - 6n 2 - 6 v 2 )F 3tU 

(v 2 — l)(w 2 — v 2 ) u 2 — v 2 {u 2 — i> 2 ) 2 (n 2 — 1) 

12vu{u 2 + v 2 — 2 )F 3 v 4u (u 4 v 2 — 8u 2 v 4 + v 6 + 5n 4 — 4n 2 n 2 + lln 4 — 6v 2 ) F 3 
(u 2 — v 2 ) 2 (l — u 2 ) (u 2 — n 2 ) 3 (l — u 2 ){y 2 — 1) 

12{2u 2 v 2 + v 4 — u 2 — 2v 2 )Fi :VU 
(u 2 — v 2 )(l — u 2 )v 

12(2w 4 n 4 + 4n 2 n 6 + v 8 — 2 u 4 v 2 — 8 u 2 v 4 — 4v 6 + u 4 + 2 u 2 v 2 + 4v 4 )F\ tU 
(u 2 — n 2 ) 2 (l — u 2 ){v 2 — l)v 2 
_ I2u(4u 2 v 4 + 3n 6 - 7 u 2 v 2 - 7v 4 + 3m 2 + 4v 2 )F liV 

( u 2 — v 2 ) 2 {l — U 2 ) 2 V 

, 12u(2uV - 4 u 4 v 4 + 5 u 2 v 6 + 3v 8 - 5 u 4 v 2 - 2u 2 v 4 - 5n 6 + 3n 4 + 3 u 2 v 2 )F 1 
+ (n 2 — n 2 ) 3 (l — u 2 ) 2 v 2 ’ 


_ I2v(v 2 - 1 )F 2>vv 12 uF 2)VU 4(u 4 + 7 u 2 v 2 + 4n 4 - 6n 2 - 6 v 2 )F 2)V 

2 (1 — u 2 )(u 2 — v 2 ) u 2 — v 2 (u 2 — v 2 ) 2 (l — u 2 ) 
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12um(m 2 + u 2 — 2 )F 2}U 4m (n 6 — 8n 4 u 2 + u 2 v 4 + 11m 4 — 4n 2 u 2 + 5 m 4 — 6n 2 ) F 2 

(u 2 — v 2 ) 2 (v 2 — 1) (n 2 — u 2 ) 3 (l — n 2 )(u 2 — 1) 

12(n 4 + 2u 2 v 2 — 2u 2 — v 2 )F ivu 
(m 2 — v 2 )(v 2 — l)n 

_ 12(u 8 + 4uV + 2wV - 4 m 6 - 8m 4 m 2 - 2mV + 4m 4 + 2mV + m 4 )F 4 ,„ 

(m 2 — m 2 ) 2 (1 — u 2 )(y 2 — 1 )m 2 
_ 12m(3m 6 + 4m 4 m 2 - 7m 4 - 7u 2 v 2 + 4m 2 + 3m 2 )F 4 , u 

(m 2 — m 2 ) 2 (m 2 — 1) 2 m 

12m(3m 8 + 5m 6 m 2 - 4m 4 m 4 + 2m 2 m 6 - 5m 6 - 2mV - 5m 2 m 4 + 3m 2 m 2 + 3m 4 )F 4 

(m 2 — m 2 ) 3 (m 2 — 1) 2 m 2 

Here the functions Fj are defined as Fj = Fj/(u 2 — u 2 ) 3 , where 

— (1 — m 2 ) 3/2 (m 2 — 1) 3 ^ 2 [u 3 A 30 o + ■um 2 H 2 oi + w^A 102 + w 3 A 0 03] 

+ (1 - m 2 ) 5/2 (m 2 - 1) 1/2 [u 3 Hi2o + uv 2 Aq2i] 

-(1 - m 2 ) 2 (m 2 - 1) [m 3 H 2 10 + UV 2 A 1U + u 2 vA 012 ] - (1 - m) 3 m 3 H 030 
F 2 — —(1 — m 2 ) 3/2 (m 2 - 1) 3/2 [3mm 2 H 300 + m(2m 2 + M 2 )H 20 1 + m(m 2 + 2v 2 )A W2 + 3m 2 mA 0 o3] 

+ (1 — m 2 ) 3//2 (m 2 — l) 1 ^ 2 [(n 2 + 2 m 2 — 3)nu 2 v4i 20 + u(3 u 2 v 2 — 2u 2 — u 2 )A 0 2 i] 

— (1 — m 2 )(m 2 — 1) [m 2 m(2m 2 + m 2 — 3)H 210 + m(m 4 + 2m 2 m 2 — 2m 2 — u 2 )A m 
+m(3m 2 m 2 — m 2 — 2m 2 )A 012 ] — 3(1 — m) 2 (m 2 — 1)mu 2 A 03 o 
F 3 = (1 - n 2 ) 3/2 (u 2 - 1) 3/2 [3 m 2 mH 300 + m(m 2 + 2m 2 )H 20 i + m(2m 2 + v 2 )A 102 + 3uv 2 A 003 ] 

+ (1 — n 2 ) 4 / 2 (u 2 — l) 3 ^ 2 [(2 m 2 + v 2 — 3)m 2 mA 120 + m(3m 2 m 2 — m 2 — 2m 2 )A 02 i] 

+ (1 — m 2 )(m 2 — 1) [m 2 m(m 2 + 2m 2 — 3)v4 2 i 0 + m(m 4 + 2m 2 m 2 — m 2 — 2m 2 ) A m 
+m(3m 2 m 2 — 2m 2 — M 2 )H 0 i2] — 3(1 — m 2 )(m 2 — 1) 2 m 2 mA 0 3o 
F 4 = — (1 — m 2 ) 3/2 (m 2 — l) 3 / 2 [m 3 H 30 o + m 2 mH 20 i + uv 2 A W2 + m 3 A 0 03] 

-(1 - m 2 ) 1/2 (m 2 - 1) 5/2 [m 3 Hi20 + U 2 vA 02 i] 

-(1 - m 2 )(m 2 - l) 2 [m 3 H 2 io + u 2 vA lu + uv 2 A 012 ] - (m 2 - 1) 3 m 3 H 030 

As in the case of the separation in the parabolic coordinates, we can see immediately from 
the form of the linear compatibility condition (fT8|) that both of the functions W\ and W 2 
will have only non-movable singularities unless either F 2 = 0 or F 3 = 0. However, since both 
of the functions depend on all of the Ajke s and will vanish only if all of the coefficients do, 
there will be no such solution. In other words, if any of the Ajke s are not 0 then both W\ and 
W 2 will satisfy linear determining equations and so will have only non-movable singularities. 
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Let us conclude this section with a discussion of the solutions of the linear determining 
equations (jT8T) . In each of the previous cases, the coupled ODEs were separated by taking a 
sufficient number of derivatives to remove one of the functions from the equation. However, 
the linear determining equations in the elliptic case have coefficients that are not rational 
functions and so this method breaks down. One may try to get rid of the square roots by 
isolating them on the right-hand side and then squaring the equation. However, although 
we get rid of the square roots in this way, we have to deal with a nonlinear equation, that 
not surprisingly turns out to be even more complicated than the original condition (fT8lh 
A fruitful direction seems to be to follow the method that was initially used by Graved, 
namely to evaluate the linear compatibility condition at a supposedly regular point, for 
example x = 0 and y — 0 in Cartesian coordinates and u,v = ±1 in elliptic. Of course, 
these points may well happen to be singular points of the potential, as was the case in 
Cartesian coordinates, possibly leading to some solutions being lost. However, in the elliptic 
case even this simplification leads to systems of ODEs that are difficult to solve. Still the 
classification of third-order superintegrable systems that admit separation of variables in 
elliptic coordinates remains an open problem. 


IV. CONCLUSION AND OPEN PROBLEMS 

In this article, we consider the problem of a Hamiltonian system that admits separation 
of variables in orthogonal coordinates in two-dimensional Euclidean space as well as another 
integral of degree three in the momentum. For systems that separate in subgroup-type 
coordinates, several new families of such potentials were already identified^’ 6 - 7 . There are 
potentials that satisfy linear determining equations, for example the 3:1 oscillator, as well as 
potentials that depend on nonlinear special functions, such as the Painleve transcendents. 
In section 2, we have reviewed the conditions necessary for the existence of such nonlinear 
potentials. Namely, the requirement that one of the determining equations for the potential, 
the so-called linear compatibility condition either vanishes or depends only on a function 
of one variable. For subgroup-type coordinates, this condition can be satisfied for certain 
non-zero values of the coefficients Aj k £. On the other hand, for systems that separate in 
parabolic coordinates^ the linear compatibility condition will be independent of hhi(^) or 
W 2 ('?/) if and only if all the A ]k p are 0, leaving a first-order integral instead of a third. The 
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main result of this paper is to finish the classification with a similar statement for the elliptic 
coordinate case, where it has been shown that all potentials will also have only non-movable 
singularities and so will not depend on nonlinear special functions. 

This leads to at least two interesting open problems and conjectures. The first open 
problem is to solve the linear determining equations for the elliptic case and to classify all 
systems with a third-order integral that admit separation of variables in elliptic coordinates. 
In the parabolic case, all of the obtained potentials admitted an additional second-order 
integral of motion, so that the third-order integral was the Poisson or Lie bracket of the 
two second-order ones, neither being the Hamiltonian. We conjecture that this is also the 
case in elliptic coordinates so in particular there are no new superintegrable Hamiltonians 
separable in the elliptic coordinates possessing a third order integral of motion. 

The second open problem is to explain the difference between the two pairs of cases. Why 
should it be that subgroup type coordinates are necessary to allow superintegrable potentials 
that depend on nonlinear special functions? Furthermore, the lack of new solutions in the 
parabolic and, if true, in the elliptic case is striking and the connection with the type 
of orthogonal separation is not clear. It is interesting to note that in 2D both subgroup 
coordinates have at least one ignorable coordinate (i.e. a coordinate that does not appear 
in the metric) whereas the non-subgroup type coordinates don’t. In higher dimensions, this 
is no longer the case and in particular there exist coordinate systems with an ignorable 
coordinate that are not of subgroup type^ 2 . Thus extending the classification to higher 
dimensions may help to clarify the mechanism for existence of such “nonlinear” potentials. 
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